Escaping from cycles through a glass transition 
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A random walk is performed over a disordered media composed of sites random and uniformly 
distributed inside a d-dimensional hypercube. The walker cannot remain in the same site and 
hops to one of its n neighboring sites with a transition probability that depends on the distance 
D between sites according to a cost function E{D). The stochasticity level is parameterized by a 
formal temperature T. In the case T = 0, the walk is deterministic and ergodicity is broken: the 
phase space is divided in a 0{N) number of attractor basins of 2-cycles that trap the walker. For 
d = 1, analytic results indicate the existence of a glass transition at Ti = 1/2 as A'^ — > cxa. Below 
Ti, the average trapping time in 2-cycles diverges and out-of-equilibrium behavior appears. Similar 
glass transitions occur in higher dimensions when the right cost function is chosen. We also present 
some results for the statistics of distances for Poisson spatial point processes. 
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I. INTRODUCTION 

Random walks in random media constitute an inter- 
esting mathematical problem with several physical ap- 
plications P, 0]. The study of deterministic walks in 
random media is also a fascinating topic but presents 
dilRculties (nonergodicity, for instance) common to the 
area of dynamical systems. The statistics of such deter- 
ministic walks, which present transient and cycling parts, 
have been much less investigated Ji, 4, 5, 7J up to date. 
Here we investigate the transition from deterministic to 
random walks in a disordered medium. We find that 
escaping from a cycle dominated phase is done through 
a glass transition in the "weak ergodicity breaking" sce- 
nario present in Limo ge-B ocquet jg] and Bouchaud's trap 
models H E IH IHM 13 

Any spin lattice model with deterministic parallel up- 
date may be viewed as performing a deterministic walk in 
its phase space. Examples are the Little model 0, 
(a "Hopfield neural network" with parallel dynamics), 
asymmetric neural networks with parallel update |l7j . 
Kauffmann Boolean networks 0|, etc. Since such sys- 
tems have a huge and complex phase space, it is interest- 
ing to compare their behavior to other simpler dynamical 
systems with quenched disorder. This is the rationale for 
studying toy models as the Random Map ^3 that shares 
some generic statistical and dynamical properties with 
those more complex systems. 

A phase composed only by 2-cycles (i.e. cycles involv- 
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ing only two states) occurs in the neural and Kauffman 
networks cited above. However, such 2-cycle phase is not 
present in the Random Map model. Recently, we intro- 
duced a simple dynamical system with quenched disorder 
that presents such a phase: the Tourist Walk 0, IE 0- 
It is a deterministic walk over a set of N points. The 
points may be sites in a c?-dimensional Euclidean space 
or nodes in a graph with ordered neighborhood (for 
example, a thesaurus graph Q). The Tourist Rule is: at 
each time step, the walker must go to the nearest site 
not visited in the past t steps (a self-avoiding window). 
We have found that, for any r window, the phase space 
is divided in a 0{N) number of basins of p-cycles attrac- 
tors. In particular, when t = 0, all attractors have period 
p = 2. For T = 1, in the d — > cx) limit, the Tourist Walk 
presents a power law distribution of cycle periods of the 
form P{p) oc p~^, with a cutoff which scales with -s/^. 
This is similar to the distribution present in the Random 
Map model 

The above lattice systems also have been studied with 
stochastic dynamics. We expect that above a certain 
temperature the dynamics is no longer dominated by the 
cycles. It is not clear how to introduce a stochastic dy- 
namics in the Random Map but we found that it is easy 
(and even natural) to introduce a formal temperature T 
in the Tourist Walk such that the deterministic limit is 
recovered when T = 0. The main question we address 
here is how ergodicity could be recovered from such de- 
terministic dynamical systems with quenched disorder. 
The introduction of dynamical stochasticity is necessary 
to break the cycles, but a low level of stochasticity may 
not be sufficient for full ergodicity recovery. Indeed, we 
have found a glass- like transition at a finite stochasticity 
level (temperature) Tc. We expect that a similar be- 
havior is present in, for example, stochastic versions of 
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KaufFman networks. 

Here we consider a stochastic Tourist Walk where 
the walker, at site i, is allowed to jump to its first n 
neighbors with a transition probability proportional to 
exp[~E{Dij)/T]. The stochasticity level is parameter- 
ized by T (a formal temperature) and the cost func- 
tion E{Dij) is a monotone increasing function of the 
distance between the sites. When the formal tempera- 
ture T is zero, one has a simple Tourist Walk without 
self- avoiding window (r — 0): the walker always goes 
to the nearest neighboring site, eventually being trapped 
in a 2-cycle when a pair of reciprocally nearest neigh- 
bors is found. For T > 0, the 2-cycles are no longer 
stable, being characterized by a distribution of trapping 
times P{tr). However, for low values of T, the walker is 
in an out-of-equilibrium regime, presenting a divergent 
average trapping time when N oo ("weak ergodicity 
breaking" scenario H, H 113, IH IH El El ) ■ Increasing 
T, one is able to study the ergodicity recovery transition 
where the average trapping time becomes finite. For one- 
dimensional systems this occurs at Ti = 1/2 for all values 
of the connectivity n. 

The paper is organized as follows. In Sec. ^ we define 
the model and set the notation. In Sec. lIIII we show that 
the network structure, where hops occur, forms a directed 
graph. This graph presents interesting sets of points that 
we call sinks and sources. We present analytic results on 
the density of sinks of a given size. In Sec. II VI we obtain 
some joint distributions of distances for Poisson spatial 
point process. These results are used in the calculation 
of bounds for the average trapping time in 2-cycles. In 
Sec. 13 we show that in one-dimensional systems there is 
a glass transition at Ti = 1/2. Below Ti, the average 
trapping time diverges and the system falls into an out- 
of-equilibrium state. A discussion on the existence of 
such glass transitions in higher dimensions is presented. 
Exploratory behavior with a power-law hopping process 
is discussed via the introduction of a proper cost function. 
Om' final remarks and conclusions are offered in Sec. lVIll 



II. DESCRIPTION OF THE MODEL 

The model is defined by an underlying disordered lat- 
tice composed of N sites, whose coordinates x^*^^ {i ~ 
1, . . . , N; k = 1, . . . ,d) are distributed uniformly in the 
rf-dimensional unitary volume [0, l]**. From the sites co- 
ordinates, one constructs the Euclidean distance matrix: 



Now consider a hopping process between sites. The 
transition probability from site i to site j is defined as: 
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where the factor iV^/'' has been introduced to simulate 
a constant density of points, when the thermodynamical 
limit iV — > oo is taken. In this limit, the point distri- 
bution is equivalent to that of a Poisson process in 3?'', 
using the geometrical distance. 



where the normalization factor is: 



PE{Di. 



(2) 



(3) 



with the sum running over the n nearest neighbors (nn) 
of point i. The cost function E{Dij) depends only on the 
distances Dij, and is a monotone increasing function. 

Several scenarios can be envisaged. If E{Dij) = Dij 
then the transition probability decays exponentially with 
the distance. If E{Dij) = D'jj a gaussian decay is ob- 
tained for W,^j. If E{D,j) = In Aj , then W,-,, cx D^f 
decays as a power law of the distance. 

Notice that the transition probabilities are not sym- 
metric {Wi-,j 7^ Wj^i) because the normalization fac- 
tors are different {Zi ^ Zj): the neighbors of i are not 
the same as the neighbors of j. Furthermore, the walker 
is not allowed to remain at the same site, i.e., Wi-ti = 
(which is equivalent to setting Da ^ oo in the distance 
matrix) . 

The stochastic parameter or "temperature" T = 1//3 
regulates the distance dependent bias of the model. 
When P ^ 0, all the transition probabilities are equal 
and one obtains unbiased hopping inside a disordered 
lattice. When /3 — s- oo, in Eq. Q the term corresponding 
to the first nearest neighbor dominates, yielding either 
Wi^j = 1, if the site j is the nearest neighbor of site i, 
or Wi^j = 0, otherwise. The tourist goes imperatively to 
the nearest site, relative to the actual position, thus per- 
forming a deterministic walk without a self-avoiding 
window (that is, with t = 0). 

Observe that the model has not been defined in a reg- 
ular lattice because in that case the number of nearest 
neighbors is degenerated (greater than one) and deter- 
minism cannot be recovered. The prohibition for the 
walker to remain at the same site is needed to fulfill the 
Tourist Walk rule. 

When n = — 1 , any site is accessible from any other 
site. However, if n is small, the underlying network is a 
diluted directed graph. Such graphs have a complicated 
topology: some sites may not be accessible from other 
sites and the graph may be disconnected. Thus, we will 
first study the topology induced in this graph by a finite 
degree n of outgoing links. Afterwards, we present the 
dynamical ("glass") transition that occurs in the walks 
performed on this graph, when T is sufficiently low. 



III. TOPOLOGY OF THE UNDERLYING 
NETWORK 

We have assumed that transitions occur only to the 
first n nearest neighbors of each site i. Viewing each 



transition term Wi^j as the weight of the hnk between 
sites i and j, we obtain a directed network or graph. 
The degree distribution of outgoing hnks is a delta func- 
tion, P{kout) — Sk,m and the distribution of ingoing hnks 
P{kin) is binomial. Notice however that this is not a 
random graph, as it is restricted to a c?-dimensional Eu- 
clidean space, and thus it cannot be fully characterized 
by using only the distribution of ingoing and outgoing 
links. This graph is the underlying network where deter- 
ministic Tourist Walks occurs (if we set n = t + 1), so it 
has been called a Tourist Graph. 



A. Sinks and Sources 

For all finite values of n, topological constraints induce 
special sets of points. For example, using n = 2 and 
d = 2, consider a set of three points such that each point 
has the other two points as nearest neighbors. All the 
outgoing links of such points remain inside this set of 
three points, forming a triangle. If this triangle does not 
receive any ingoing link from outside points, this triangle 
is an isolated cluster. If it receives some ingoing links, it 
acts as an absolute trap: the cluster may be attained from 
outside, but there is no possibility to escape from it, since 
there is no transition terms Wi—,j to any site j outside the 
triangle. Such sets, that do not present outgoing links, we 
call sinks. When these sinks are minimal (i.e. there are 
no smaller sinks inside them), they correspond to what 
are called irreducible closed sets in the terminology of 
Markov processes . Sinks are composed of persistent 
states and the rest of the graph is composed of transient 
ones 0. Notice that, since there are always n outgoing 
links from each point, a single site cannot be a sink. Sinks 
have a minimal size of n -I- 1 points. 

Consider also a set of points (or even a single point) 
that present outgoing links to points outside the given 
set, but with no ingoing links from exterior points. Such 
sets are called sources. A walk may be started inside a 
source, but if the walker exits this set, she cannot return 
to it any longer. 

Sinks and sources are easily visualized in dimension 
d = 1 (see Fig. because we can define special points 
( "walls" ) . A site w is a (semi-permeable) wall whenever 
all of its n outgoing links point along the same direction. 
However, w may have ingoing links from the opposite 
direction, that is, the walls behave as semi-permeable 
membranes: they allow the flux of walkers from one side 
to another but not the other way around. Thus the walls 
are characterized by the directions in which the walker 
flux is allowed. This is indicated in Fig. ^ by arrows 
and, as a shorthand, we say that the wall "points" to the 
direction indicated by the large arrows. 

In c? = 1 systems, two consecutive walls define different 
regions on the disordered lattice depending on their ori- 
entation. If the two walls point to the center of a region 
(inwards) (|=><J=|), the set of points comprised by all the 
points between the walls is a minimal sink. Once a walker 




Sink Source Sink Source 



FIG. 1: Sinks and sources in one dimension. Large arrows 
represent walls. 



attains a sink, there is no escape: the only permissible 
movement is to wander stochastically inside it. If the two 
consecutive walls point outwards a region (<=||=5'), this 
region is a source. Once a walker escapes from such a 
region, it cannot return. 

Going to a higher level of description, our graph can 
be characterized by the sets discussed in Refs.l2llandl2^ 
For d > 1 and large enough values of n the graph has a gi- 
ant weakly connected component (GWCC) made of points 
connected by links (without considering their direction) . 
Inside this set, there is a giant strongly connected compo- 
nent (GSCC), where every point is accessible from every 
other point of the set through a directed path. This is 
the set where, most probably, a random walker roams 
until she eventually falls into a sink. By definition 2^, 
the GSCC does not contain either sinks or sources. The 
(disjoint) set of sources whose outgoing links lead to the 
GSCC is the in-component (IN), i. e., the set of points 
from where the GSCC is reachable but cannot be reached 
from it. If the walker is initially placed in the IN, she will 
leave this set for the GSCC in a relatively small amount 
of time. The disjoint set of sinks that can be reached from 
the GSCC is called the out-component (OUT). This is the 
set where almost every random walker will end up. These 
are the greatest sets in our graph, but other smaller sets 
are possible. For example, the set of all the sources that 
are not connected to the GSCC, but to other sinks. Or 
the set of sinks that cannot be reached from any other 
point in the graph. 

In d = 1, due to the very special topology of 5R, things 
are different. Sinks disconnect the graph (nothing passes 
from one side to the other of a sink) and a GSCC cannot 
be formed. 

Notice that the presence of sources and sinks occurs 
even in the high temperature limit (T — > oo). It is a 
topological property, not a dynamical one, emerging from 
the fact that each site has only n outgoing links. The 
glass transition discussed in Section has nothing to 
do with such topological constraints. Simulations show 
that it is present even in the fully connected case n — 
N — 1. Sinks are an undesirable (although inevitable) 
factor that complicates the study of the glass transition in 
our random walk. On the other hand, finite connectivity 
allows us to extract some analytical results, which is not 
the case for n ^ oo. 
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B. Density of sinks 

Next we calculate the density of sinks in one dimension 
and ask for the conditions which enable the emergence of 
a single macroscopic connected region where any point is 
reachable from any other. 

In ci = 1, a sink is formed by two inward walls where 
each wall site has n outgoing links. Thus, the smallest 
sink comprises n+1 points. It is possible to calculate 
explicitly the density (also called concentration) Cm{n) 
of sinks with sizes n + m for m small. 

Consider a set of n + 3 consecutive points, relabeled as 
i — 1, . . . ,n + 3 and with coordinates Xi. Let Xi = x^+i — 
Xi be the distance separating two consecutive points. We 
first calculate the probability that point i = 2 is a wall 
pointing to the right and that, simultaneously, point i = 
n + 2 is a wall pointing to the left with no wall between 
these two walls. If Xi is greater than the total distance 
between points i = 2 and i = n + 2, then point i = 2 
is a left wall pointing to the right. Similarly, if Xn+2 is 
greater than the total distance between points i = 2 and 
i = n + 2, then point i = n + 2 is a right wall pointing to 
the left. Since points are randomly spaced along the line 
(Poisson process), the probability of having a distance 
Xi is: P{Xi) = e"^'. Thus, the concentration of sinks 
having n + 1 points is: 



/n+2 iL-r± 
l[{dX,e-''^)Q(X^-Y,X^) 

1=1 1=2 
n+1 , 

xe(x„+2-5]x,) = -. 



n+1 



(4) 



Similar (but more cumbersome) calculations give the 
concentration for the next two sink sizes ( n+2 and n+3). 
For n > 2: 



C2{n) 
C3{n) 



1 



4 1^3"-! 
1/1 



1 



16 V 3 



5n-l 
1 



1 1 



1 1 



3n-2 



^n-2 



9 7" 



12 9 



(5) 

n-2,(6) 



For large values of n, C2{n)/Ci{n) 3/4 and 

C3 (n) /C2 (n) 3/4. One may conjecture that, asymp- 
totically, this will hold true for all size concentrations. 
In other words, Cm+i{n)/Cm{n) — > 3/4 for all val- 
ues of m. If this conjecture is valid, the fraction of 
points that belong to sinks is, asymptotically, F(n) = 
Em=i("^ + n)Cmin) = (4n -|- 20)/3" and the total con- 
centration of sinks is C{n) = J2m=i^"ii^) — 4/3". 
This means that for large values of n the graph is ef- 
fectively disconnected and the clusters have on average 
[1 - F{n)]/C{n) = (3" - 4n - 20)/4 points. 

This result can be used to estimate the minimum value 
of n for which there exists a single cluster of size 0{N). 
If one imposes NC(n) = 1 one gets nmin = ln(47V)/ln3. 
This implies that it is not necessary to take n = N — \ 



to have a single macroscopic cluster: it can be obtained 
with very high probability for low values [©(In A^)] of n. 

It is easy to see that for higher dimensions and finite n 
there will also be a finite fraction of sinks and sources, in 
the thermodynamical limit N — > 00. However, numerical 
evidence presented in Sec. IV Bl seems to imply that the 
glass transition studied in Sec0 occurs in the GSCC, 
that is, outside the sinks and sources. 



IV. COUPLE STATISTICS 

In this section we obtain the density of couples (which 
form 2-cycles traps) in d dimensions and we derive prob- 
ability density functions for distances inside couples and 
between couples and their neighbors. 



A. Density of couples 

With T = 0, starting the walk at a given site, after 
a fast transient the walker eventually reaches two 
"refiexive nearest neighbors" (or "couple" , for short) [23| . 
A couple a <-^- & is formed when site a is the nearest 
neighbor of site h and h is the nearest neighbor of a. Once 
a couple is attained, the walker is trapped in a 2-cycle 
attractor (a — b — a — b — ...). As shown in Ref. for 
d = 1, the expected number of couples is M{1) = N/3, 
and for general values of d one has the couple density: 



M{d) 
N 



ip.(a 



b) 



1 



2[1+Prf(l)] 



(7) 



where Pd{a b) is the probability that a point belongs 
to a couple and 



1 



with the definitions \2l 



h{a,b) 
B{a,b) 
T{z) 



1 



B{a,b) JO 
1 



dt t''-\l-t) 



6-1 



(8) 



(9) 



dtr-i(l-t)''-i = ^ffll, (10) 



r(a -I- b) 



z-l-t 



dt t'-'e 



(11) 



where Iz{a,b) is the incomplete beta function, B{a,b) is 
the beta function and T{z) is the gamma function. The 
function pd(x) is given in Table^for some values of d, and 
its geometrical meaning is presented below (Sec. IIV B(l . 

The couples trap permanently the walker only at T = 
0. Notice that, in principle, there is no relationship be- 
tween couples and sinks (for example, couples may be 
sources). However, the special case n = 1 {a. single out- 
going link for each point) is equivalent to a T = sce- 
nario. In this case, sinks and couples are identical. From 
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d 






dVu{D^,Do)/dDi 


1 

2 
3 


X 

2 


2 

3^/^+27r 
67r 

11 

16 


2 


i[f-i(f)T 


27rDi+4Diarctan^J5i^i^f^ 
2'KDi[2Di+ Do] 



TABLE I: Expression of function Pd{x) for some values of the dimension d (see Eq. This generalizes Table 2 of Ref. For 
the last column see Eq. 12H . 



Eq. Q), Ci(l) = 1/3 gives the concentration of couples, 
which is compatible with Eq. (|7|), for d = \. 

As we are using a spatial Poisson process, the proba- 
bility of a point being located in a given volume is pro- 
portional to the volume itself and there is no correlation 
between points. Next we present some analytical results 
on the distance statistics of point processes in 3?'' that 
could be of general interest (for example, in studies of 
the Travelling Salesman Problem p^l. 



Notice that pd{x) = [V{D) - Vn{D,DQ)]/V(D), is the 
volume fraction occupied by the "hyper-crescent" . Thus, 
the total volume is: 



Vu{D,D^) = V{D) 



Do 
D 



(16) 



B. Couple distance distribution function 

First we calculate the probability density function 
(p.d.f.) for the distances between the points of a cou- 
ple. Following Cox [H, without loss of generality, we 
consider a unitary intensity Poisson process in d dimen- 
sions. For such a process the probability of having no 
points inside a hypersphere of volume V and radius D is 
e^^. Then, the p.d.f. of finding the nearest neighbor of 
a particular site a at a distance D is: 

Pnn{D) = e-^(^) = A.dD''-^ e-^(^) , (12) 

with 



V{D) = 

Ad = 



Ad 

T{d/2+\) 



(13) 



Consider also the volume of the union of two d-spheres 
of radius D centered at sites a and b separated by a dis- 
tance Do (see Fig. 12)1 : 



V^{D,Do) = 2V{D)~Vn{D,Do), 



(14) 



where Vn{D, Dq) is the volume of the intersection of two 
d-spheres whose centers are separated by a distance Dq. 
Using the variable x = cos(j) (see Fig. we get: 



Vn{D,Do) 



2V{D) 
V{D) 



V{D) 



Ax {l-x^) — 
dt r^{i - 1)- 



1 ( ^0 



(15) 
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\ Vn 1 







Vu 



FIG. 2: Union of two hyperspheres of radius D centered at 
sites a and b, which are a distance Do apart. There are no 
other sites inside the inner hyperspheres of radius Do ■ 



The joint p.d.f. that the points a and b form a couple 
and have a pair distance corresponds to the probabil- 
ity that no other points lie inside the volume Kj(^0: ^o): 



Pd{Do,a^b) 



AV{Do) _ 
-e 



Vu{D„.D„) 



dDo 



(17) 



For example, in d = 1 we have Pi{Do, a ^ b) — 2e^^^" . 
Notice that Pd{DQ,a <-> b) is not normalized: integrat- 
ing with respect to Dq one recovers the couple density 
Pdia ^ b) given by Eq. 0. 



C. Couple nearest neighbor distance distribution 
function 

th 

Define Dj as the distance of the nearest neigh- 
bor {I < j < n) to the couple a ^ b. For instance. 
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the distance of the first nearest neighbor to the cou- 
ple is Di — minjiDai, _Dhi}, that is, the minimal one 
between the distance from sites a and b to their sec- 
ond nearest neighbors. Thus, the distance of the sec- 
ond nearest neighbor to the couple will be the minimal 
one among the remaining distances (max{Dai, Dbi}) and 
{Da2,Db2}: D2 = inm{ma^{Dai,Dbi},Da2,Db2}- 

To calculate the couple's joint p.d.f. P{Do,Di), one 
asks first for the probability that the couple nearest 
neighbor is at a distance r larger than Di. That is, one 
asks for the probability that two d-spheres of radius Di, 
one centered at site a and the other centered at site b 
are empty, given the fact that the d-spheres of radius Dq 
centered at the same sites are also empty. For a Poisson 
process, this probability is: 



p-VuiDi.Do) 



(18) 



Then, the probability density function that r > Di is: 



Pdir>Di,Do) = Pdir>Di\Do)PdiDo,a^b) 



dV{Do) 
dDo ' 



-Vu{Di,Do) 



(19) 



D. Generalizing the joint distribution function 

Generalizing this procedure, the joint p.d.f. of dis- 
tances for the k nearest neighbors of the a ^ b couple 
is obtained: 



Pd{Dk,Dk-u...,Do,a^b)=cxp[-Vu{Dk,Do)] 

k r ■ 



dVuiD,,Do) 



(23) 



Notice that the above result is not normalized (stressed 
by the label a ^b). To normalize it one must divide by 
Pd{a ^ 6) = l/[l+pd(l)] (see Eq. O). For instance, for 
d = \ one has: 



Pi(-Dfc,i5fc_i,...,I?o) = 2'=3e-(^»+2^'=)I]e(A-A-i) , 



(24) 



Notice that normalized p.d.f. 's do not carry the label a 
b. 



E. Stability distribution function 



where Pd{Do, a ^ b) has been given by Eq. l(T7|l . Taking 
the derivative of the above equation with respect to Di , 
one finally obtains the probability distribution function 
to have a couple a 6 of size Dq with the first neighbor 
to the couple at a distance Di: 



Pd{Di,Do,a^b) - exp[~Vu{Di,Do)] 



dViDo} 
dDo 



where the Heaviside step function Q{Di — Dq) has been 
introduced to ensure that Di > Dq and 



dVuiDi^Do) _ VuiDi,Do)d 



dDi 



Di 

dpd{Do/Di) 
dDi 



V{Di 



(21) 



Let us define the "stability" of an arbitrary pair of 
points (a, b) (not necessarily refiexive neighbors) to be: 



A — Dnn — Dab 



(25) 



where Dnn — min{Z?ofc, Dbk} is the distance to the near- 
est neighbor fc of a or 5 not including a or b. Notice that 
if (and only if) the stability A is positive then a and b 
are reflexive neighbors (a couple). This is an alternative 
way of defining couples and we may write A = Di — Dq. 
The couple stability p.d.f. is: 



/•OC 

Pd{A) = / dDodDi Pd{Di,Do)6[A - [D^ - D„ 
Jo 

For example, for d — 1 this gives: 

Fi(A) = 2exp(-2A)e(A) . 



(26) 



(27) 



This quantity will be used when calculating the average 
residence time next section. 



where 



GLASS TRANSITION 



dpd{Do/Di 
dDi 



-Do 







1 - 







DiBU,^ 



(22) 



For the expression of d\{j{Di, Do)/dDi for some values 
of d, see tabled 



So far we have considered the topological aspects of the 
network where the walk is performed. Now we turn our 
attention to the dynamics of the hopping process. As 
mentioned before, for T = the walk is deterministic. 
After a transient the walker falls into a 2-cycle defined 
by a couple. However, for T > the couples are not abso- 
lute traps any longer, being characterized by a residence 
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Time Step (t) 



Pit) 



t odd 
t even 



la 
PaQb 
PaPhQa 
PaPbPaqb 
(PaPbfqa 
{PaPbYPaqb 
(PaPbfqa 



(PaPb) 



jPaPb 



(t-l)/2 



Paqb 



TABLE II: Probability P{t) that a walker, initially placed in 
point a, makes its first exit from the couple at time t. 



or trapping time tr. To calculate the average residence 
time let a and b be the sites of a couple, Dq = Dab their 
pair distance and Daj{Di,j) the distance from a{b) to its 
(j + l)-th nearest neighbor. Consider first a linear cost 
function E{D) — D (other cost functions will be dis- 
cussed later). The probabilities of transition from site a 
to site b and vice versa are: 



Pa = Wa^biP) 



Pb = Wb^aW 



-/3Do 



n-1 



i=0 

n-1 



.(28) 



i=0 



Suppose that at i = the walker is at site a. The 
probability that the walker remains inside the couple for 
t steps and then leaves it, is (as schemed in Table : 
Pe{t) = {paPbY^'^Qa, for cvcu valucs of t and Po{t) = 
[PaPbY^^^^^'^Paqb for odd values of t, with = 1 - 
and Qf, = I — Pb- If at t = the walker is at site 6, 
one simply has to exchange the indexes a and b in Po{t) 
and Pe(t). Since the travel may start either at site a 
or site b the probabilities that the walker remains in the 
cycle up to time t are: Pe{t) — [paPbY^^iqa + Qb)/'^ and 
Po{t) = {paPbY'^^^^'^iPaQb + Pbqa)/'2, with P{t) propcrly 
normalized: Et=o -^W = Er=o[^'=(2fc) + -Po(2fc+1)] = 1. 

The expected residence time for this couple is: 

oo oo 

P{t) t ^[Pe(2fc) 2fc + Po(2fc + 1) {2k + 1)] 

(29) 



k=0 



_ PaPb + iPa +Pb)/2 



1 - PaPb 

The calculation of the average {tr) (over all possible 
realizations of the points) is somewhat involved, for gen- 
eral values of n. The problem lies in the fact that the 
set of nearest neighbors to site a and the corresponding 
one for site 6 are neither uncorrelated (independent) nor 
completely correlated. 

The consideration of all the possible correlations in- 
volves a number of integrals that increases exponentially 
with n. Nevertheless it is possible to calculate bounds 



for (tr) which reveal its characteristic diverging behav- 
ior. To obtain these bounds, we next present a simple 
approximation which is physically intuitive followed by 
improvements to this calculation. 



A. Symmetrical and asymmetrical approximation 

In the symmetrical approximation, for n = 2, the tran- 
sition probabilities corresponding to the two members 
of a couple are taken to be equal: Pa — Pb = P = 
e-0Do/Z, using Za = Zb = Z = e~^ ^" + e ~^^^ , with 
Di — mm{Dia, Dib) (as defined in Sec. lIVC)! . The resi- 
dence time is then given by i^s = p/{^~ p) ~ e^^ , where 
A = Di — Do is the stability of the couple, defined by 
Eq. H25|) . This would be exact if the nearest neighbors 
to the couple were degenerated, that is, if there was one 
point at a distance Di from a and a point at a distance 
Di from b. 

In the general case, trs is a lower bound to tr- This 
stems from the very definition of Di : for one of the points 
of the couple the distance to its second nearest neighbor 
(SNN) is, in the general case, necessarily larger than Di . 
Thus, given Di, a couple whose members have their re- 
spective SNNs at the same distance, Di, has the shortest 
possible residence time. 

In the asymmetrical approximation, for the member 
of the couple (say, b) whose SNN is at a distance larger 
than Di, the transition probability to the SNN is taken 
to be zero, that is = 1. This leads to a residence time 
tra = 2e^^ + 1/2. This residence time clearly bounds the 
true residence time from above, because we are assuming 
that the walker cannot leave the couple from point b. 

From these approximations, one obtains: 



e'^'^ <tr< 2e 



PA , 



(30) 



The average over the disorder is calculated using 
Eq. 123: 



/ dAPi(A) el^^ = 2 
Jo Jo 



dAe-^(2-« 



2-/3 



(31) 



for P < (3^ = 2. 

Thus, the average residence time is bounded as: 



2 < {2~l3)(tr) < 5- 



(32) 



and diverges when (3 —f fic ~ 2. These bounds are shown 
in Fig. El 

Above the critical temperature the walker falls into 
traps (2-cycles) which have finite average residence time. 
This allows normal diffusion for long time scales. How- 
ever the walker eventually falls into a sink which is anal- 
ogous to an absorbing state. Notice that in general 
sinks are not couples. Sinks are absolute traps arising 
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from the finite connectivity n. Couples are dynamical 
traps and temperature allows the escaping from cou- 
ples but not from sinks. Below the critical tempera- 
ture Ti — = 1/2 the system falls into an out- 
of-equilibrium "glassy" phase where the walker explores 
deeper and deeper (more stable) couples and presents ag- 
ing phenomena like in Bouchaud's trap model 'l(f\. This 
scenario has been called "weak ergodicity breaking" by 
Bouchaud and co-workers p^ . 



B. Improved bounds for the residence time 

The previous simple calculations give insight on the 
physical mechanism involved in the divergence of the 
residence time, but we can obtain better estimates for 
the bounds on the residence time, which work for gen- 
eral values of n. Using the ordered set of distances, 
we have that Dj < Da{b)j < Dj + Dq. The sec- 
ond inequality expresses the fact that our definition of 
the set of values Dj implies that a d-sphere of radius 
Dj + Dq, centered in point a (or 6) contains at least j 
points. Thus, we can bound the normalization factors 
in Eq. as follows: Z2 < Z^^^i,) < Zi, where Zi = 



■Eri e-^""^ andZ2 



[1 + E 



This implies that pi < Pa{b) 5; P2, with pi = 



/Zi 



and p2 



-f3Do 



/Z2, which allows us to bound the resi- 



dence time: tj-i < < ^rgi with tr^ = Pi/(1 — Pi) and 

tr2 =P2/(1 -P2)- 

To average over the disorder, one needs the joint p.d.f. 
of the distances of the nearest neighbors to the couple 
(Eq. (P^ l. For d — 1 one obtains, again for /? < /3c = 2: 



2< (2-/3)(M < 



6 



3-/3 



for n = 2 , (33) 



and 



/^(n)< (2-/3)(M < for n>2, (34) 



with 



I pin) - 2 



117=1 



(35) 



In Fig. 121 we give an example of the relationship be- 
tween these bounds and the exact value of (tr), for the 
case n = 2. In fact, the comparison is made not with the 
exact value but with very tight bounds to it (solid lines 
in Fig. O that have no simple analytical form and have 
only been obtained for the particular case of d = 1 and 
n — 2 (see Appendix IXjl . 

It is easy to see that 2/(n— 1) < //3(n) < 2 for all values 
of /3. Thus, by looking at the bounds we can deduce that 



(tr) too diverges when j3 ^ j3c 
of n. 



2, for all finite values 



The function l2{n) can be proven to be a decreas- 
ing function of n. But it would be interesting to know 
whether it tends to a positive constant as n — > 00, or 
it tends to zero. We have not been able to calculate 
this limit analytically. Nevertheless numerical results 
(see Fig. show that hin) seems to decrease toward 
a positive constant (^ 0.56). This suggests that a glass 
transition also exists in the limit n — > 00. 

Moreover, as n grows, the decay of l2{n) is very slow 
compared to the exponential decrease of density of sinks 
(C(n) ~ 4/3"). Thus, the divergence of the residence 
time should not depend on couples inside the sinks; it 
seems to be produced only by couples in the GSCC. This 
suggests that the glass transition occurs to walkers in the 
GSCC before they fall into sinks. 



CO. 

O 




FIG. 3; Bounds for the average residence time for d = 1 with 
n = 2. Here C-.(/3) < (2 - (3){tr) < C+(/3). The ascending 
dashed curve is the upper bound given by Eq. 13311 and the 
descending line is the upper bound given by Eq. 1321 . The 
horizontal line is the lower bound C_ = 2 common to both 
equations. Solid lines are the tighter C± bounds obtained in 
Appendix 1X1 



Distribution of residence times 



The origin of the glass transition that appears in d = 1 
is related to the trapping times p.d.f. P{tr)- Exact ana- 
lytical results are difficult to obtain. Nevertheless the 
probability distribution for the approximate residence 
times in and tr^ (defined in the preceding section) gives 
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with 



0.70 



0.65 



0.60 



0.55 




Ed 



{d- 



d + 1 1 

" 2 



B 



d-1 



2d^ -3 

xd! d 2<i-2 TT 



2 

d? -d/2-1 



(39) 



3-2d 
2d-2 



(40) 



10 12 14 16 



where Ad is given by Eq. 

Thus, there is no glass transition when d > 2 for the 
hnear cost function E{Dij) — Dij. However, as we show 
below, there is a specific cost function which yields a glass 
transition for each dimension. 



FIG. 4: Numerical calculation of l2{n) as a function of n 
showing that l2{n) tends to a positive constant. 



2. Generalized cost functions 



an idea of its behavior. For the case n = 2, we obtain: 



dDo dDiPd(Do,Di)S 



l.-(2//3+l) 



dDo dDiP{Do,Di)d 



6 .-{2/p+l) 



(36) 



(37) 



The divergence of the average residence time is a direct 
consequence of the fact that the tail of these distributions 
decays with exponent 7 < 2 when (3 > 2. Thus, the 
behavior of the walker is dominated by couples which 
have far apart nearest neighbors. 



VI. GENERALIZATION TO HIGHER 
DIMENSIONS AND DIFFERENT COST 
FUNCTIONS 



For higher-dimensional systems (d > 1), the calcula- 
tions of the properties of the system become harder but 
some estimates can be obtained. 



1. Asymptotic behavior of the residence times 

It is possible to calculate the behavior of (t^i ) and (t^a ) 
when n = 2. For d > 2 and /? ^ 1, the calculated 
asymptotic bounds to (tr) are: 



1 



< 



(tr) 



< 1 



(38) 



Consider the general case where the transition rates 
have the form Wi^j = exp[—f3E{Dij)]/Zi with an arbi- 
trary cost function E{Dij). In the symmetric approxi- 
mation, the average residence time is: 



(tr 



dDidDoPdiD,, Do)e 



PlE{Di)~E{Do)] 



(41) 



where Pd{Di, Dq) is given by Eq. (|24|1 fusing k — 1). 
It is clear that the two competing factors which cre- 
ate the possibility of a glass transition are: i) the tail 
of Pd{Di, Do) and ii) the exploding exp[(3E{Di)] factor. 
As it can be seen from Eq. the tail of Pd{Di,Do) 

is: Pd{Di,Do) oc exp{—AdDf), where Ad is given by 
Eq. I|13(l . Thus, the symmetric approximation leads to: 



{tr 



OC 



dDi 



^l3E{Di)-A^D-^ 



(42) 



Consider, for instance, the family of cost functions: 
E = Df^. If a is smaller than d, the residence time is 
always finite and no glassy behavior is observed (as we 
have previously observed in the case d = 2 and a — 
1). The limiting case T = — > will be examined 
elsewhere. On the other hand, if a > d, the system is 
always in the glassy state for any value of (3. 

If the cost function exponent is equal to the space di- 
mensionality, a — d, the two terms in the argument of 
exponential function in Eq. I|42|l can compete indepen- 
dently of the value of Di and a glass transition occurs 
at (3d = Ad = n'^/^/r{d/2 + 1). For example, /3i = 2 
for d = 1 (as seen previously), (32 = tt, for d = 2 and 
(33 = 47r/3, for d = 3. 

This kind of glass transition generalizes those found in 
trap models. In trap models, once the tail of the bar- 
rier distribution is given (say, a gaussian tail as in Ref. 
IT^ . one cannot carpenter the Arrhenius term to com- 
pete with it. This is different in our exploratory random 
walk model. In our case what is given is not the barrier 
distribution P{E), but the distance distribution P{Dij) 
which characterizes the landscape. Since the transition 
probability for exploratory random walks depends on an 
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arbitrary cost function E(Dij), one can always find what 
condition must be satisfied by the cost function so that 
a glass transition occurs. 

3. Levy flights 

From Eq. H42(l one sees that any a < d prevents the 
glass transition. In particular, one can study the limit 
a — > 0, i.e., E{Dij) = In Dij. In this case, a hopping 
process with power law tail, Wi^j = D~f / J2jenn ^if 
found. Transition probabilities with power law ("Levy") 
tails lead to finite average residence times for any value 
of d. Such Levy exploration pro cess has been considered, 
for instance, in Refs. |23) l2M 123 . 

But glass transitions may occur if the distribution of 
point distances also has power law tails. For example, 
suppose that the points coordinates are drawn from some 
distribution that produces P{Di,Dq) cx D^^ . Then, the 
diverging part of the residence time integral has the form 
{Us) oc / dDiD^'\ This means that a glass transition 
occurs ii P > (3c = b — 1. 

VII. CONCLUSION 

We have introduced a random walk in a disordered 
medium dependent on a control parameter which tunes 
the system from an ergodic to a non-ergodic regime 
through a glass transition. The random walk is similar to 
a hopping process in a multivalley landscape. The d ~ 1 
"local minima" or traps emerge as 2-cycle attractors pro- 
duced by sites which are mutual nearest neighbors. For 
d = 1 these traps present a power law distribution of 
trapping times and the average trapping time diverges 
for T < Tc = 1/2, leading to a "glass" transition in 
the weak ergodicity breaking scenario of Bouchaud's trap 
model 10, 12]. Given any distribution of distances and 
any dimensionality, one can always find a cost function 
for which a similar glass transition occurs. 

The analytical treatment to estimate the bounds of the 
average residence time has been possible because we have 
considered finite connectivity. The finite value of n is also 
responsible for the appearance of special sets of points 
(sinks and sources) in the directed graph where the walks 
are performed. Sinks are absolute, inescapable topologi- 
cal traps insensitive to temperature. Couples (that pro- 
duce 2-cycles) are relative traps that can be escaped with 
finite temperature. We have considered a possible glass 
transition involving couples before the walker falls into 
sinks. Given the behavior of the bounds to the average 
residence time, we also expect a glass transition to ap- 
pear in the fully connected network with n = N — 1, 
where no sinks exist, only couples. 

Concerning the application of our model to exploratory 
behavior, one (a posteriori) obvious conclusion is that 
free exploration (diffusion or super diffusion) occurs when 
the tail of the hops p.d.f. decays slower than the tail 



of the first neighbors distances p.d.f. However, if costs 
are associated to the travelling distance, the marginal 
scenario, where the two p.d.f. tails (a = d) compete, 
may be of interest. We conjecture that working at the 
glass transition border may be optimal when high costs 
are associated to travel distances (this will be presented 
elsewhere) . 

The 2-cycle phase (at zero temperature) and the glassy 
behavior of the stochastic Tourist Walk may be compared 
to similar behaviors in neural and Kauffman networks. 
Such comparison is not possible by using the Random 
Map. The random walk in a disordered graph introduced 
here is interesting because it generalizes the usual trap 
models: in the Tourist Walk traps are made of dynam- 
ical cycles instead of energy minima. We are currently 
studying the stochastic Tourist Walk with memory r > 0, 
so that traps are cycles with large periods (similar to 
what happens in Kauffmann networks and asymmetric 
neural networks tlTj). We expect that the relevant fea- 
tures should be the same as those observed in the present 
work. In short, if one wants to escape from vicious cy- 
cles, small perturbations may not be sufficient: freedom 
only appears above a finite temperature Tc. 
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APPENDIX A: IMPROVED BOUNDS 

In this appendix we derive tighter bounds than those 
given by Eqs. and but they are only valid in 

the special case of d = 1 and n = 2. 

Consider first a couple of points, a and b, separated 
by a distance Dq. To calculate Za and Zt (see Eq. fl^ ) 
one only needs the positions of a and b and their two 
nearest neighbors. The first neighbor to each of them 
is, by definition, the other member of the couple. Since 
the distribution of the distances of the neighbors to the 
couple is known, one needs to determine which of these 
neighbors is the second-nearest neighbor (SNN) to a and 
which is the SNN to b. 

Without loss of generality we assume b to be the right- 
most point of the couple. The first neighbor to the cou- 
ple (called FNNC) is taken to be placed at a distance Di 
(with Di > Dq), and at the right of b, what makes it the 
SNN to b. Now the task is reduced to the determination 
of the SNN to point a. 

When one considers the position of the second nearest 
neighbor to the couple (called SNNC), at a distance D2 
(with D2 > Di), three possibilities arise for the SNN of 
a: 
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I. D2 > Di + Do- In this case, the SNN to a is the 
FNNC, and its distance to point a is: Di + Dq. 

II. D2 < Di + Dq, but it is placed to the left of a. 
In this case, the SNN to a is the SNNC, and its 
distance to point a is: _D2- 

III. D2 < Di+ Do, but it is placed to the right of b. In 
this case one needs to know the position of further 
neighbors to the couple to obtain the SNN to a. If 
they are placed at distances larger than Di + Dq, 
then the SNN to a would be the SNNC. Otherwise, 
one would have to know which neighbors, of those 
having distances smaller than Di + Dq, are placed 
to the left of a. 

The corresponding residence times can be calculated 
exactly for cases I and II. 

For case I, the partition functions are: Zai(/3) = 
e-PDo + g-/3(Do+Ci) and Zbi{(i) = e"''^'' + e"^^!. For 
case II they are: Za//(/3) = e-'^°° +e-f^°^ and Zmi{P) = 

Eqs. 129(1 and (|28|l yield the residence times: 



trliP) 
trlliP) 



1 + + e-l3D, 



)/2 



g-/3Z5i _|_ e-/3-D2 + g/3(Do--Di-n2) 



(Al) 



The problem with triii is that to calculate it ex- 
actly one needs to break case III into an infinity of 
particular cases. For our purposes it suffices to calcu- 
late some bounds to its real value. As it has been dis- 
cussed in case III, the distance of point a to its SNN 
satisfies: D2 < DsNNa < Dq + Di. Therefore, it is 
clear that the corresponding residence time must satisfy: 

tri < trIII < tril- 

Remembering that the probability for a given point to 
be at one side of the couple is 1/2, and averaging, one 
obtains the bound: 



J dDodDi dD2Pi{Do, Di,D2) [^6(^2 - Di ~ Do) 



trI + tril 



Q{Di+Do-D2) 



< iu) < 

J dDodDidD2Pi{Do,Di,D2)[trMD2-Di-Do) 
+trii e{Di + Do - D2)] . (A2) 



We have calculated these integrals numerically, and the 
resulting bounds are presented as full lines in Fig. |3| 
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